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PREFACE 


The work described in this publication wee performed by the 
Mathematical Analysis Research Corporation (MARC) under contract to 
the Jet Propulsion Laboratory, an operating division of the Cellfomla 
Institute of Technology. This activity Is sponsored by the Jet 
Propulsion Laboratory under contract NAS7-918, RE182, A187 with the 
National Aeronautics and Space Administration, for the United Stetes 
Army Intelligence Center and School. 
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The transformation from a non-955 ellipse depends on whether the 

incoming ellipse size was computed using a x* value or using an F value*. The 
conversion algorithms presently used are x* values regardless of how the 
Incoming ellipse size was computed. When the incoming ellipse size is based 
on the F then the conversion is incorrect. That is, the converted ellipse is 
too small. The amount of error depends on the sample size used for the 
incoming ellipse. The smaller the sample size the greater the error. 



This conversion error effects: 

1) The accuracy of the test which determines whether or not to accept 
the incoming data as coming from an emitter already located in the 
data base. 

2) The accuracy of the combination algorithm which combines the 
Incoming ellipse with an ellipse already in the data base. 


Footnote: Zn general a x* value is used if the variance* covariance of the 

data is known and an F value is used if the varianoe-covarianee of 
the data is estimated. 




Under 1) 

The error is too frequently stating that the incoming data do not come 
from a specific emitter when in fact they do. 

Under 2 ) 

There are two possible errors. 

The resultant ellipse being too small. 

The location of the center of the resultant ellipse being overly 
affected by data based on small sample sizes. 

GENERAL 

The F distribution is used in determination of EEPs (elliptical error 
probable) for some programs such as Guardrail. Ellipse confidence level 
conversion algorithms, combination algorithms and combination testing 
algorithms assume that EEPs are based on the Chi-square distribution. This 
memo is not concerned with all the problems that result from this discrepancy 
for these three types of algorithms. It is concerned with the direct Impact 
on the confidence level conversion algorithm and with the implications of this 
impact for the combination and testing algorithms. 

When the original distribution underlying EEPs is F, converting ellipse 
confidence coefficients to the 95} level is an approximation that is only 
valid for 'large' sample sizes. This memo is designed to illustrate the 
impact of using this approximation with small sample sizes. The ideas 
Introduced include: 

i) The interpretation of the conversion of confidence level as a 
rescaling of the size of the confidence ellipse, 
li) The factors affecting the scaling constant, specifically, 

(a) the confidence level of the Incoming ellipse 

(b) whether the original distribution is Chi-square or F 

(c) sample size (but only if the original distribution is F) 
ili) The amount of error in ellipse size that can occur. 

iv) What the difference between chi-square and F is supposed to 
represent. 

v) The effect of scaling errors of the type being examined here on 
correlation testing. (And questions concerning use of that test 
when F is the basis for formation of the ellipse.) 
vi) The effect of the scaling errors being studied here on the point 
estimate location determined by the combination algorithm. (And 
questions concerning use of this algorithm when F is the basis for 
formation of the ellipse.) 

vil) The effect of the scaling errors being studied here on the EEP 
size of the resultant ellipse using the combination algorithm. 

When incoming EEPs are based on sample sizes of 5 or smaller these 
considerations are very important. 

The concepts outlined above will be discussed in the sections below. 

They are also illustrated in the graphs that follow, and may be pursued 
further using the tables attached in the appendices. (Other graphs concerning 
ellipse combination and testing for combination may easily be imagined in 
terms of the geometric characterization of the testing and combination 
algorithms. ) 
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I. INTERPRETATION OF CONFIDENCE LEVEL CONVERSION AS RESCALING EEP'S 


Changing confidence level may be thought of as scaling of the EEP (size 
of a confidence ellipse.) in fact given two confidence levels with specified 
confidence methodologies and sample size (for the F) it is possible to list 
the scaling factor. For example, if sample size is 5 (and assuming our 
applications have 2 spatial degrees of freedom) then a 905 EEP based on the F 
distribution is approximately 2.5 times as large as the corresponding 50* EEP. 
The 95 * EEP approximately 3*3 times as large as the corresponding 505 EEP. 

This ellipse size ratio is illustrated in Graph 1 that follows. 

The shape, location, and orientation of the base ellipse do not affect 
the scaling factor. The scaling factor does depend on which distribution and 
sample size is used for the base ellipse and converted ellipse, however. 
Because correlation algorithms assume 955 confidence levels the tables in the 
appendix assume that the converted ellipse has this confidence level. (The 
Ellipse Radius Ratios listed at the top of each table are Chi-square to 
Chi-square and the entry in the table are F to F). Because of this 955 
convention the 2.5 scaling factor for sample size 5 between the 505 F and 905 
F EEPs is not listed in the table. The 505 F to 955 scaling factor (for 
sample size 5) of 3.3 (3*292) is listed in thi; table, however. 

11. FACTORS AFFECTING THE SCALING FACTOR 

A. The Confidence Level of the Incoming Ellipse. 

If the incoming ellipse is based on a 955 confidence level bound 
then no conversion is necessary. 

If the incoming ellipse is based on a 905 confidence level 
then the scaling factor will be bigger than one and the resultant 
ellipse will be bigger. Examination of the 905 F radius ratios in 
tables in the Appendix confirms this. (As do the conversion factors 
for the Chi-square conversions which are listed above the tables.) 

If the incoming ellipse is based on a 505 confidence level then 
the scaling factor for conversion will be even bigger than if the 
incoming ellipse had been a 905 confidence ellipse. This can be seen 
both in Graph 1 and by comparison of 505 radius ratios with 905 radius 
ratios in the appendix. 

B. The Distribution (Chi-square or F) Underlying the EEPs. 

Chi-square scaling factors are closer to 1 than F scaling 
factors. Note that the columns of F cutoff values are all bigger than 
the corresponding Chi-square cut-off value listed at ve the table. 

C. The Sample Size. 

Sample size affects the F scaling factors as can be seen in the 
tables in the appendix and in Graph 4. The tables and Graph 4 also 
illustrate that as sample size Increases the F converges toward the 
Chi-square. 

Sample size doesn't affect the Chi-square scaling factors. This 
is probably why sample size has not been sent to the correlation 
algorithm in the past. 

D. The Degrees of Freedom 

This factor is usually based on spatial dimension and hence is 
fixed in most applications and will not be discussed in detail here. 





III. THE AMOUNT OF ERROR IN ELLIPSE SIZE THAT CAN OCCUR 
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This section is concerned about the difference between what a person 
sitting at a scope would observe and what he should be observing. The 
assumption is that a conversion has been done to make the ellipse a 959 
ellipse but that that conversion was done using Chi-square scaling factors. 

Of course, if the ellipses were based on the Chi-square distribution no 
error is made. But what if the distribution underlying the incoming ellipse 
was F? 

If the incoming ellipse was a 951 F there is still no error as the 
conversion scale is 1. If, however, the incoming distribution wasn't at 959 
then there is an error because a Chi-square radius ratio was used rather than 
an F radius ratio. The ratio between the Chi-square radius ratio and the F 
radius ratio is the natural measure of this error. This information is 
provided in the tables in the appendix under the unfortunate column title of 
CHI-F RATIO RATIO. The ratios depend on the confidence level so there are 
actually two columns. The entries in these columns are measures of the 
conversion error. Graph 2 might clarify these concepts. The inner ellipse in 
the graph is assumed to be a sample size 5 • 2 degrees of freedom, 509 F 
incoming ellipse. This inner ellipse is probably not actually seen by the 
operator during correlation. The middle ellipse is what a chi-square 
conversion would construct and presumably report to the operator. The outer 
ellipse is the correctly converted ellipse. 

Note that the difference is in Graph 2 is significant and examination of 
the tables in the appendix make it clear that even more significant 
differences exist. The larger RATIO RATIO entries reflect larger errors. 

This is illustrated In Graph 3 for which the 90-959 based RATIO RATIO is 
1.1603 and the 50-959 based RATIO RATIO is 1.5860. This example and 
examination of the tables also show that the 509 to 959 conversion error is 
always larger than the 90-959 error, as one would expect. Graph A illustrates 
how this error decreases with sample size. In the limit, as sample size 
increases, the RATIO RATIO would approach one and there would be no 
significant error. 

IV. WHAT DOES THE DIFFERENCE BETWEEN F AND CHI-SQUARE SCALING MEAN 

The F based EEPs are bigger chi-square EEPs because chi-square assumes 
that the amount of error that one la subject to is known, whereas the F 
assumes the amount of error that one is subject to is unknown and only 
determined as data comes in and variation is found. The truth probably lies 
somewhere between these two assumptions. The fact that the F assumes an extra 
type of uncertainty (the amount of error that one is subject to) Implies that 
it yields bigger EEPs. The higher the confidence level the more this 
uncertainty is reflected and hence the RATIO RATIOS get bigger as the 
difference between the base confidence level and the resultant Increases. 

The dependence on sample size is more problematical, however. The 
authors of this report suspect that unmodeled sources of error would prevent 
the uncertainty in ellipse size from going away to the extent it does as 
sample size Increases using the F test. 

V. THE IMPACT OF SCALING ERRORS ON TESTING FOR COMBINATION 

The nature of scaling errors is that incoming ellipses appear to be 
smaller than they really are. This means that the incoming ellipse is more 
likely to overlap the base ellipse by enough to accept (l.e. there is less 
acceptance the bigger the RATIO RATIO Value.) This is illustrated in Graph 5 
where the incorrectly converted ellipse rejects and the correctly converted 
ellipse accepts. (Examples may be constructed geometrically bearing in mind 
that non- intersecting ellipses reject and that if the center of one ellipse is 
in the other ellipse then the acceptance test will reject.) 





VI. THE IMPACT OF SCALING ERRORS ON DETERMINING A POINT ESTIMATE 

The resultant point estimate is a type of weighted average between the 
two original point estimates (although the result is not necessarily actually 
on the line segment between the points.) The weights are based on ellipse 
’•smallness.” Changing ellipse size changes the weighting. The ellipse that 
is corrected to a larger size is weighted less and the location estimate will 
be adjusted away from the point estimate corresponding to that ellipse. 
Examination of graphs 6, 7, and 8 in sequence illustrate this point. 

VII. THE IMPACT OF SCALING ERRORS ON DETERMINING A POINT ESTIMATE 

The resultant ellipse size is based on the ellipse sizes of the two input 
ellipses. Bigger input yields a bigger output. See Graphs 6, 7, and 8 for an 
•example. See MARC'S report, "Testing and Combination of Confidence Ellipses: 

A Geometric Analysis", for more details about the relationship of the geometry 
of input ellipses and output ellipses. 
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aphs 6, 7, and 8 illustrate the results (resultant 
lipse) when incorrectly and correctly converted ellipses 
e combined with Base Data. 



Data Base 95% Ellipse 
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Chi-square vs. F test CONFIDENCE LEVEL Conversion 
2 DEGREES OF FREEDOM 


CHI-SQUARE cut-off values does not depend on the nunber of data points. 

50? cut-off value- 1 .39 
905* cut-off value- *.6l 
95% cut-off value- 5.99 

50? TO 95? cut-off ratio *.3Q9 ELLIPSE RADIUS RATIO- 2.075 
90? TO 95? cut-off ratio- 1.299 ELLIPSE RADIUS RATIO 1.139 



50? 

90? 

95? 

50? 

90? 

50? 

90? 


50 CHI-F 

90 CHI-F 

SAMPLE 

CUTOFF 

CUTOFF 

CUTOFF 

CUTOFF 

CUTOFF 

RADIUS 

RADIUS 


RATIO 

RATIO 

SIZE 

VALUE 

VALUE 

VALUE 

RATIO 

RATIO 

RATIO 

RATIO 


RATIO 

RATIO 

3 

3 

99 

399 

133 

*.030 

11.53 

2.007 

— 

5.5556 

1.761* 

* 

2 

18 

38 

19 

2.111 

*.358 

1.*52 

— 

2.0998 

1.27*8 

5 

1.762 

10.92 

19.1 

10.83 

1.7*9 

3.292 

1.322 


1.5860 

1.1603 

6 

1.656 

8.6* 

13.88 

8.381 

1.606 

2.895 

1.267 

— 

1.39*6 

1.1120 

7 * 

1.598 

7.56 

11.58 

7.2*6 

1.531 

2.691 

1.237 

— 

1.2968 

1.0858 

8 

1.56 

6.92 

10.28 

6.589 

1.*85 

2.567 

1.218 

— 

1.2366 

1.0693 

9 

1.53* 

6.52 

9.*8 

6.179 

1 .*53 

2.*85 

1.205 

— 

1.1975 

1.0579 

10 

1.50* 

6.22 

8.92 

5.930 

1.*3* 

2.*35 

1.197 

— 

1.1731 

1.0507 

11 

1.*98 

6.02 

8.52 

5.687 

1.*15 

2.38* 

1.189 

— 

1.1*88 

1.0*37 

12 

1 .*86 

5.8* 

8.2 

5.518 

1.*0* 

2.3*9 

1.18* 

— 

1.1316 

1.0396 

13 

1 .*78 

5.72 

7.96 

5.385 

1.391 

2.320 

1.179 

— 

1.1179 

1.0350 

1H 

1.*7 

5.62 

7.78 

5.292 

1.38* 

2.300 

1.176 

— 

1.1082 

1.0323 

17 

1.*52! 

5.* 

7.36 

5.068 

1.362 

2.251 

1.167 

— 

1.08*5 

1.02*3 

22 

1 .*36 

5.18 

6.98 

*.860 

1.3*7 

2.20* 

1.160 

i 

1.0620 

1.018* 
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APPENDIX 


Chi-square vs. F test CONFIDENCE LEVEL Conversion 
3 DEGREES OF FREEDOM 


CHI-SQUARE cut-off values does not depend on the nuntoer of data points. 

50? cut-off value* 2.37 
90? cut-off value* 6.25 
95? cut-off value* 7.81 

50? TO 95? cut-off ratio 3.295 ELLIPSE RADIUS RATIO 1.815 

90? TO 95? cut-off ratio 1.249 ELLIPSE RADIUS RATIO 1.117 



50? 

90? 

95? 

50* 

90? 

50? 

90? 

— 

50 CHI-F 

90 CHI-F 

SAI^PLE 

CUTOFF 

CUTOFF 

CUTOFF 

CUTOFF 

CUTOFF 

RADIUS 

RADIUS 

_ 

RATIO 

RATIO 

SIZE 

VALUE 

VALUE 

VALUE 

RATIO 

RATIO 

RATIO 

RATIO 


RATIO 

RATIO 

3 

5.13 

160.8 

648 

126.3 

4.029 

11.23 

2.007 

— 

6.1915 

1.7962 

4 

3.39 

27.48 

57.6 

16.99 

2.096 

4.122 

1.447 

— 

2.2708 

1.2954 

5 

3 

16.17 

27.84 

9.28 

1.721 

3.046 

1.312 

— 

1.6782 

1.1740 

6 

2.823 

12.57 

19.77 

7.003 

1.572 

2.646 

1.254 

— 

1.4578 

1.1221 

7 

2.721 

10.86 

16.23 

5.964 

1.494 

2.442 

1.222 

— 

1.3454 

1 .0938 

8 

2:658 

9.87 

14.28 

5.372 

1.446 

2.317 

1.202 

— 

1.2769 

1.0762 

9 

2.613 

9.21 

13.05 

4.994 

1.416 

2.234 

1.190 

— 

1.2311 

1.0651 

10 

2.58 

8.76 

12.21 

4.732 

1.393 

2.175 

1.180 

— 

1.1984 

1.0563 

11 

2.556 

8.43 

11.58 

4.530 

1.373 

2.128 

1.172 

— 

1.1725 

1.0487 

12 

2.535 

8.19 

11.13 

4.390 

1.358 

2.095 

1.165 

— 

1.1543 

1.0430 

13 

2.52 

7.98 

10.77 

4.273 

1.349 

2.067 

1.161 

— 

1.1388 

1.0395 

14 

2.505 

7.83 

10.47 

4.179 

1.337 

2.044 

1.156 

— 

1.1262 

1.0346 

17 

2.478 

7. M 7 

9.87 

3.983 

1.321 

1.995 

1.149 

— 

1.0994 

1.0285 

22 

2.448 

7.10 

9.3 

3.799 

1.302 

1.949 

1.141 

— 

1.0737 

1.0212 
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